FEDDOCS 
D 208.14/2; 



LIBRARY 

TFCHNJCAl REPORT SECTION 
NAVAL postgraduate SCHOOL' 
MONTEREY, CALIFORNIA S394Q 



NPS55-77-23 _ 

NAVAL POSTGRADUATE SCHOOL 

Monterey, California 




EFFICIENT COMPUTATION AND LONG RANGE 
OPTIMIZATION APPLICATIONS USING 
A TWO-CHARACTERISTIC MARKOV-TYPE 
MANPOWER FLOW MODEL 

by 

Kneale T. Marshall 
May 1977 

Approved for public release; distribution unlimited, 
d for; 

- 55 - 77-23 rters Marine Corps, Code MPI20 
ton, D.C. 20380 



NAVAL POSTGRADUATE SCHOOL 
Monterey, California 



Rear Admiral Isham Linder Jack R. Borsting 

Superintendent Provost 



This work was supported in part by the Manpower Planning Division (MPI20) 
of the Marine Corps through the Navy Personnel Research and Development 
Lab. , San Diego. 

Reproduction of all or part of this report is authorized. 



Unclassi fied 



SECURITY CLASSIFICATION OF THIS PAGE (When Date Entered) 



REPORT DOCUMENTATION PAGE 


READ INSTRUCTIONS 
BEFORE COMPLETING FORM 


1. REPORT NUMBER 2. GOVT ACCESSION NO. 

NPS55-77-23 


3. RECIPIENT'S CATALOG NUMBER 


4. TITLE fand Su6(/((«; 

Efficient Computation and Long Range Optimiza- 
tion Applications Using a Two-Characteristic 
Markov-Type Manpower Flow Model 


5. TYPE OF REPORT A PERIOD COVERED 

Technical 


6. PERFORMING ORG. REPORT NUMBER 


7. AUTHORfs; 

Kneale T. Marshall 


8. CONTRACT OR GRANT HUHBER(a) 


9. PERFORMING organization NAME AND ADDRESS 

Naval Postgraduate School 
Monterey, California 93940 


10. program element. PROJECT, TASK 
AREA A WORK UNIT NUMBERS 

N6822177WK70052 


11. CONTROLLING OFFICE NAME AND ADDRESS 

Naval Postgraduate School 
Monterey, California 93940 


12. REPORT DATE 

May 1977 


13. number of PAGES 
18 


14. monitoring AGENCY NAME A ADORESSr// cf///eranf from Controlling Office) 


15. security class. (oI thl» report) 

Unclassi fied 


15«. DECLASSI FI cation/ DOWN GRADING 
SCHEDULE 



16. DISTRIBUTION STATEMENT (of this Report) 



Approved for public release; distribution unlimited 



17. DISTRIBUTION STATEMENT (of the abatraet entered In Block 20, If different from Report) 



18. supplementary notes 



19. KEY WORDS (Continue on reverae aide if neceeeary and Identify by block number) 

Manpower; Personnel Optimization; Markov 



20. ABSTRACT (Continue on reverae aide If neceaaary and Identity by block number) 

In [11 the author has compared and contrasted Markov and longitudinal man- 
power flow models. The Markov model requires relatively little data and has 
been widely analyzed (see [2] and [3]). The longitudinal model incorporates 
more realistic personnel flows, but requires extensive data which is not 
always available. In [4] Hayne and Marshall analyze a two-characteristic 
Markov model which can be viewed as a hybrid of the Markov and longitudinal 
models. The purpose of this paper is to show how efficient computational 



1473 EDITION OF 1 NOV 65 IS OBSOLETE 
S/N 0102-014- 6601 i 



DD 

1 JAN 73 



SECURITY CLASSIFICATION OF THIS PAGE (When Data Entered) 




^l-CIJt<|TY CLASSIFICATION OF THIS PAGErWTien Data Entered) 



20. methods can be used with the two-characteristic model by exploiting the 
special structure of its underlying matrix. These methods make possible the 
efficient use of this basic flow model in optimization models similar to those 
described in Chapter 5 of [3]. 



security classification of this PAGErWhen Da^• Entered) 



EFFICIENT COMPUTATION AND LONG RANGE OPTIMIZATION APPLICATIONS 
USING A TWO-CHARACTERISTIC MARKOV-TYPE 
MANPOWER FLOW MODEL 
by 

Kneale T. Marshall 
Naval Postgraduate School 
Monterey, CA 93940 

ABSTRACT 

In [1] the author has compared and contrasted Markov and 
longitudinal manpower flow models. The Markov model requires 
relatively little data and has been widely analyzed (see [2] and 
[3]). The longitudinal model incorporates more realistic 
personnel flows, but requires extensive data which is not always 
available. In [4] Hayne and Marshall analyze a two-characterist i 
Markov model which can be viewed as a hybrid of the Markov and 
longitudinal models. The purpose of this paper is to show how 
efficient computational methods can be used with the two- 
characteristic model by exploiting the special structure of its 
underlying matrix. These methods make possible the efficient use 
of this basic flow model in optimization models similar to those 
described in Chapter 5 of [3] . 



TABLE OF CONTENTS 



Page 



1. Introduction 1 

2. Model Formulation 2 

3. The Structure of il(a) and P(a) 5 

4. Computation of ^-(a) and P(a) 11 

5. Numerical Example 15 

References 18 



1. Introduction 



In a previous paper [1] the author has compared and 
contrasted cross-sectional and longitudinal manpower flow models. 
The cross-sectional, or Markov, model requires relatively little 
data and has been widely analyzed (see, for example, [2] and [3]). 
The longitudinal model incorporates more realistic personnel 
flows, but requires extensive data which is not always available. 
In [4] Hayne and Marshall analyze a two-characteristic cross- 
sectional model which can be viewed as a hybrid of the Markov 
and longitudinal models. In Chapter 5 of [3] Grinold and the 
author present some long-range optimization models based primarily 
on the longitudinal model. 

The purpose of this paper is to show how efficient 
computational methods can be used with the two-characteristic 
model by exploiting the special structure of its underlying 
matrix. These methods make possible the efficient use of this 
basic flow model in optimization models similar to those described 
in [3]. This paper explores this application in detail when the 
two characteristics of the state are grade and time-in-grade. 
Approximate solutions are found to infinite horizon linear 

programs using methods similar to those in [3]. 

This paper relies heavily on the notation 

and results in [3] and [4]. The reader is referred there 
for details. Section 2 contains a formulation of the 
optimization model and its approximation (see [3], Chapter 5, 
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pages 186-209) . Section 3 contains results on the structure 
of the flow matrices, their generating function for the 
(Grade, Time in Grade) model, and the legacies and their generating 
function. Section 4 describes efficient methods of computation 
for these generating functions. Section 5 gives a simple numeric 
example which the reader may wish to follow simultaneously with 
the theory in Sections 3 and 4. The example has been kept small 
and simple because of space limitations and for ease of exposition. 



2 . Model Formulation 

It is assumed that manpower joins a system on one of 

K chains, and at some discrete time t is counted in one of 

n classes if it is still in the system. Let P(u) be an 

n X K matrix with element p. . (u) equal to the fraction of 

13 

manpower that enters on chain j which is in class i, u periods 
after entering the system. The matrices P(0), P(l), ... 

describe the flow through the system. 

Let g(u) be a K-element column vector of flows 
into the system on each chain at time u = 1,2,...; let £(u) 
be an n-eleraent column vector of legacies in each class at time 
u = 1,2,... of manpower which enter up to and including time 
t = 0, which is taken to be the current time. If s(t) is an 
n-element vector of stocks in each class at time t = 1,2,..., 
then 
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( 1 ) 



t 

s(t) = I P(t-u) g(u) + 2.(t) . 

u=l 

In [3] Grinold and Marshall used this chain-flow model 
as the basis of a linear optimization model (see Chapter 5) . 

Let a be a discount factor, a an n-element vector of one- 
period costs on stocks, b a K-element of one-period costs on 
new hires, p the constant size of the system, A a constraint 
matrix on stocks and B a constraint matrix on flows. Finally 
let e be a vector with all elements equal to 1. 

Consider the infinite horizon linear program (LP) 



Minimize ^ a^[as(t) + bg(t)] 
t=l 



PI. 



Subject to: es(t) = p 
As (t) ^ 0 
Bg(t) > 0 
g(t) > 0 



t = 1,2, 



It is shown in [3] that the solution to a K-variable 
single period problem can be used to generate solutions to PI 
which are usually optimal and always good approximations. Let 



P(a) = J a^P(u) , 1(a) = 2-(u) and c = aP(a) + b. 

u=0 u=l 



Then by using (1) to eliminate s(t), and multiplying the t-th 
period constraints in PI by and summing, we obtain 
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P2, Minimize eg 

Subject to; eP(a)g = [ap/(l-a)] - eJ,(a) 

AP ( a ) g ^ -M (a ) 

Bg ^ 0 

g ^ 0 

This LP has only K variables g. Let g* be the optimal 
solution to P2. In [3], Chapter 5, it is shown how scalars 
Y(1); Y(2),... can easily be found successively such that, if 
we let g*(t) = Y (t)g*, then these g*(t) are often optimal 
in PI (they are optimal if A is vacuous) . 

The purpose of this paper is to analyze the structure 
of P(a) and i{a) in P2 when 

(i) The system can be partitioned into a hierarchical 
structure of grades 

(ii) A two-characteristic cross-sectional flow model is used 

with a state described by the 2-tuple (Grade, Time in Grade) . 
This is called the (G, TIG) -model. 

(iii) Entering a chain corresponds to entering a grade, necessarily 
with TIG equal to 1. 

(iv) A class corresponds to a grade. 

We use the results of Hayne and Marshall in [4] for the (G,TIG) 
model. For example, in a simple model of a university faculty 
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the grades might be Assistant Professor, Associate Professor and 
Full Professor. Let us assume that the maximum number of periods 
(years) a person can spend in these grades is 6, 30, and 30. 

The number of states in the (G,TIG) model is 66, so that a cross- 
sectional flow matrix, say Q, (66 x 66) would have 4356 elements, 
most of which would have value zero. One of the matrices P (u ) 
in (1) would be 3 X 3 with only 9 elements, since chains 
map onto grades with TIG equal to 1 and stocks are also measured 
only in grades. Any given manpower policy will imply certain 
element values for Q. In this paper we show how to find P(u) 
and Jl(u), and hence P(a) and £(a), from Q in an efficient 

manner. Thus policy changes can be reflected in the chain flow 
model through Q, where the effects of such changes on P(u) 
could not be determined directly. A simple numerical example 
is given in Section 5 following the theory. The reader may 
wish to follow the example concurrently with the theory. 



3 . The Structure of £(a) and P(a) 

The number of grades in the system is n (= K ) . Let 

r n 

the maximum time in grade j be u(j), and let H = u(j). 

Then I is the number of states in the system. Let Q be the 
one-period flow matrix for the (G,TIG) model. The u-period flows 
are given by q'^. We now relate the i x H matrix to the 

n X n matrix P(u) . 
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Let r 


be an n x 


matrix where row 


j has 


(i) 


the 


first 




elements equal to 


0, 


(ii) 


the 


next 


u(j) elements equal to 1, 




(iii) 


the 


remaining elements 


equal to 0 . 





Let 0 be an il x n matrix where column j has 
(i) the (u ( j-1) +1) -th element equal to 1 (element 1 when 

j = 1) 

(ii) all other elements equal to zero. 

Then 

(2) P(u) = , u = 0,1,2, .. . . 

Recall that P(a) = P(u). Using (2), if we let 

(3) N(a) = (I - aQ)"^ 
then 

(4) P(a) = rN(a)4> . 

Recall also that £(a) = y°° , 2.(u). 

^u=l 

Let a be the 2- -vector of stocks of manpower in each 
state at time t = 0. Then 

2. (u) = TQ^a , u = 1 , 2 , . , . 

and therefore, 

(5) 2.(a) = aF(N(a) - Do 
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Notice from (4) and (5) that to determine P(a) and 2. (a) 
we need to compute the n y I matrix rN(a). But first we look 
at the structure of N(a), the inverse of the large sparse 
matrix (I - aQ) . 

show that for the (G,TIG) model 
has the structure 



Vl ’ On,. 

where Q is a u(j) u(j) matrix and P. is a u(j + l)^' u(j) 

j ^ 

matrix. All other submatrices of Q have O's as elements and 
are suppressed. In addition each contains zeros except 

for the lower diagonal. 



In [4] Hayne and Marshall 
the cross-sectional flow matrix Q 



(6 ) 



Q = 



(7) Qj = 




0 q . / X T 0 

^3,u(3)-l -* 

^ 1,2,. . . , n . 
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Also each contains zeros except for the top row, 



( 8 ) 



P . = 
J 



Dl 

0 



'j2 



^j,u(j) 

0 



, j = 1,2, .. . ,n-l, 



The inverse of (I - aQ) can be written 



(9) 



N(a) = 



N^^(a) 



Nni(a) 



N , (a) N fa) 
n,n-l nn 



where 

N . . (a) = (I - aQ . ) 

3J 3 

and 

N.. = a^~^N . . (a) (P . ^N. , . , (a) ) (P.N..(a)) 

11 33 1-1 l-l/l-l 1 11 

for j > i. Thus N(a) is completely determined by the inverses 
{Nj j (a), j = 1,2, ...,n}. 

Now let 
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( 10 ) 






for k > i , 



‘ 1.1 



the product of (k-i) nonzero elements of • Then 



(11) N_(a) = 



1 



“ n3^(j) 



1»~1 / \ 



® 32 <"> 



“"u(j),u(j-D ^ 



1 lf2/**«/ n / 



Thus all the elements of N^_. (a) are determined from the partial 
products in (10), and all the elements of N(a) in (9) are 
determined by multiplication of these with the vectors forming 
the top rows of the in (8). However, the matrix N(a) in 

(9) need never be explicitly determined in order to find P(a) 
and 5, (a). We make the following observations. 



( 12 ) 




PjNj j (a) is a matrix with nonzero elements only 
in the top row (i.e., it has the same structure 
as (8) ) . 

If IT is any matrix with the same structure as 
(8) with as many rows as ^ (a) has columns, 
then Njj(a)n requires only the first column of 
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Now let 



r = Max{u(j), j = 1,2,..., n} , 



and let W(a) be an n x r matrix with the j-th row equal to 
the nonzero elements of multiplied by a, preceded by a 1, 

and O's added to the right as necessary. Thus 



(13) W(a) = 



1 aq^^aq ^2 “^l,u(l)-l' 



0 , 



1 aq2j^aq22 



“^2,u(2)-l'°' • * • ' 



0 

0 



1 aq , aq „ 
^nl ^n2 



aq 



n , u (n) -1 



where it has been assumed that u(l) < u(2) < u(n) = r for 
clarity. Similarly, let V(a) be an n x r matrix with the 
j-th row equal to the nonzero elements of multiplied by a, 

with O's added to the right as necessary, for j _< n-1, and 
row n a row of O's. Thus 



ap 



11, °^Plu(l) 



/ • • • / 



0 , 



“P 2 I' “P2,u(2) 



, 0 

, 0 



(14: 



V(a) = 



ap 



nl' 



'°^^n,u(n) 



0 , 
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Finally let S be an n x r matrix of stocks at time zero, where 



element gives the stocks in grade i with time in grade 

equal to j . Thus S is a matrix representation of the vector cr 



with O's added where necessary. Let T(j) = u(i). 



Then 



(15) 



S = 



'^T(l) ® 



°T(1)+1 ^T(l)+2 



Qt(2) 0 ---O 



^T(n-1)+1 '^T(n-l)+2 



'T(n) 



All the information required to determine I (a) and P(a) is 
contained in W(a), V(a), and S. Both can be found using simple 
row operations on these compact matrices. In the 3 grade, 66 
state example given earlier V, W and S are each 3 x 30 and 
contain a total of 270 elements. Storage of the Q matrix to 
find (I - aQ) ^ directly would require 4356 elements, and direct 
inversion would necessitate inverting a 66 dimensional very 
sparse matrix. Total storage for both Q and a would be 
4422 elements. 



4 . Computation of 1(a) and P(a) . 

Let V and w be any two n-vectors. We define a 
vector-valued function F(v,w) on these such that 



(16) F(v,w) = [(v, + w_v_+ • • • + w„w- ♦ • *w V ) , (v„ + w_v,+ • • • +w,w . • • *w v ) , 

i Z 2 2 3 nn 2 3 3 nn 



. . . , (v T + w V ) , V ] . 

n-1 n n n 
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We can extend this function as follows. If V and W 
are matrices of the same size, then F(V,W) is a matrix X with 
the same dimensions as V and W, and if v and w are the 
j-th rows of V and W, respectively, then (16) gives the j-th 
row of X. The function F is the key to the efficient calcula- 
tion of both Z(a) and P(a) , since by using it we can 
efficiently compute rN(a). 

Let U be an n X r matrix such that element (i,j) is 
1 if element (i,j) of W(a) is positive, and is 0 otherwise, 
where W(a) is given by (13). Also let 

Vj = eNjj(a) , j = 1,2, ...,n. 



the column sums of 

Now let V . be v . 

3 3 



N..(a) in (11). Thus v. is 
33 3 

followed by r-u(j) zero's. 



a u(j) -vector. 
Then 



(17) 



V. 



F(U,W(a)) = 



V, 



V 

n 



an 



j 

by 



n X r matrix. 

Now let 

1,2,... , n — 1 , 

r-u(j) zero's 



m. be the top row of the matrix 
3 

a u(j) -vector, and let m^ be 
Then 



P .N . . (a) 
3 33 



m. followed 
3 
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(18) 



F (V(a) ,w(ot) ) = 



m. 



m. 



m 



n-1 
0 

an n X r matrix. Equations (17) and (18) contain all the required 
data for FN(a). Let be the first element of any vector v. 

Then using the results in (11) and (12), 



(19) TN(a) = 






1 1 



^ 3"'2 ^3 



11 1 

V m ♦ • ‘m^mT 
n n-1 2 1 



n 



an n X matrix. 

Consider now the determination of P(a) = FN(a)$ . From 
(19) and the definition of $ we see that 
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(20) P(a) = 



an n x n matrix. This can be constructed from the first columns 
of (17) and (18). 

To determine i {a) we require FN(a) and a. From 
(19) it is easy to see that it can be constructed from (17), (18), 

and (15) . 

We now illustrate efficient APL functions to compute the 
various matrices. The reader should consult [5] for details 
of APL programming. 

Let Ml and M2 be any two matrices of the same dimension. 
Then the APL function 



v: 



1 1 
^ 2^1 



V. 



Ill 



^ 3™2 



11 11 

v^m ,♦ • *m.,m, 
n n-1 2 1 



n 



, V R*-M\ F M2iX 

( 21 ) 

[ 1 ] £■ -*- ( J X \ 2 + 0 = M 2 ) X 4> + \ 4> 1 X ,Y + 0 = Z X \ a; 2 

V 

calculates F{M1,M1) as defined by (16). Let V, W and S be 
APL variables for the matrices V(a) , W(a) and S in (14) , (13) , 

and (15) respectively. Then (17) is given by (W > 0) F W, and 
(18) by V F W. If we let these be Y and Y respectively, 
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and let N be the number of grades and P be P(a), then 



( 22 ) 



( \!V ) 



. > i// ) X ( b ( W , /n pA'C ; 1 ] ) X X V ( x \ f 1 , z ) , [ 1 ]<? ( /V , 'V - 1 ) pZ^ U y r ; 1 ] 



Finally, if is the APL variable for a, and L the variable 

for 1(a), then from (5), and the arguments above 

(23) L-A^i (+/AxS) + (Px((x/i^)o.>i,i;)x(-v,/',')piZ,i) + .x + /yxS)- + /5. 



5 . Numerical Example 

Assume we have 3 grades and that the maximum time in 
each grade is 3, 4 and 5 periods. Thus n = 3, u(l) = 3, u(2) = 4, 
u(3) = 5, r = 5. The matrix Q in (6) is 12 x i2 and contains 
the following 5 non-zero submatrices (see (7) and (8)) 





0 

1 


0 


I 

O 




.05 


.1 


00 


= 


.9 


0 


0 


p = 


0 


0 


0 










1 


0 


0 


0 




0 


.8 


O 




0 


0 


— r 
o 



0 


0 


0 


0 




0 


0 


.1 


.7 


.95 


0 


0 


0 




0 


0 


0 


0 


0 


.9 


0 


0 




^2 " 


0 


0 


0 


0 


0 


0 


. 85 


0 




0 


0 


0 


0 












0 


0 


0 


0 _ 


0 


0 


0 


0 


0 










.9 


0 


0 


0 


0 










0 


.9 


0 


0 


0 










0 


0 


. 8 


0 


0 










_ 0 


0 


0 


. 7 


0 
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The starting stocks are given in the 12-vector 

o = (100, 73, 70, 82, 65, 63, 58, 59, 48, 30, 25, 

Let a = 0.9. Then from (13) . (14) and (15) we have the 
matrices 



W(a) = 



1 .81 
1 .855 

1 .81 



.72 
. 81 
. 81 



0 0 
.765 0 

.72 .63 



V(a) = 



045 

0 

0 



09 



0 

0 



.72 

.09 

0 



0 0 

.63 0 

0 0 





100 


73 


70 


0 


0 


s = 


82 


65 


63 


58 


0 




59 


48 


30 


25 


20 


, by 


using 


(21) 


we 


obt 


ain 



F(U,W(a)) = 



and 



F(V(a),W(a)) = 



2.393 1.72 100 

3.077 2.429 1.765 1 0 

3.236 2.761 2.174 1.63 1 



.538 .608 .72 0 0 

.398 .463 .472 .63 0 

0 0 0 0 0 



Then using (22) and (23) 



P(a) = 



2.393 0 0 

1.655 3.077 0 

0.689 1.282 3.236 



and 



£(a) = (172.7 691.9 805.8) 



20 ) . 
3x5 
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Once P(a) and £(a) have been determined they can be 
used in the optimization problem P2 to find optimum input flows 
each period. Suppose we wish to measure the effect of a change 
of policy. Let us assume for example that we want to test the 
effect of limiting the maximum time in grade 2 to 3 periods, 
and of extending the maximum time in grade 3 to 6 periods. Then 
W(a), V(a), and S each become 3x6 matrices. But (21) can be 
used with any sized matrices and so (22) and (23) readily give the 

new values of P(a) and £(a) for use in resolving P2. The 

computational speeds involved in these calculations, including 

* 

solving P2 and determining g (t) = y(t)g, are of the order 1 or 

2 seconds for systems with about 10 grades and a maximum time 

in grade of about 30 periods. Thus interactive computer models 
can be designed so that the manpower planner can sit at a terminal 
and test alternate policies or design manpower systems. 
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